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(54) Digital signal processing 

(57) According the present invention there is pro- 
vided apparatus for matching a plurality of functions to a 
digital signal so as to represent the digital signal in 
terms of said functions comprising a first processor for 
determining one or more common factors in the plurality 
of functions; and means for representing at least some 
of the functions in terms of one or more others of said 
functions thereby to reduce the amount of processing 



necessary for the matching. 

This has the advantage that there is no unneces- 
sary processing to determine the basis functions. 
Where there is commonality and the process would 
require less processing potential to make use of this 
than not then the commonality is exploited. 



Fig.5. 
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Description 

[0001] This invention relates to improvements in or 
relating to the processing of digital signals, for example 
broadcast digital signals. 

[0002] Broadcasting of digital signals is now a well- 
established technology. Information in the digital 
domain can undergo a number of signal processing 
processes which essentially compress the amount of 
data that needs to be transmitted. For example in Digital 
Television it is possible to compress the signal such that 
less than 1% of the required information needs to be 
transmitted. This means that many Digital Television 
channels can be transmitted in the same bandwidth that 
would previously be used for only one analogue televi- 
sion channel. 

[0003] There are a number of well-known techniques 
for compressing digital data; these include the MPEG II 
standard for digital compression and wavelet compres- 
sion techniques. A problem that exists with this type of 
signal processing is to find a numerical representation 
of signals that is well suited for performing the proc- 
esses of coding, noise removal, feature enhancement 
or pattern recognition. It is desirable to decompose the 
signals into basis elements that are locally adapted to 
the signal structures and frequency content. The classi- 
cal methods identified above build signal representa- 
tions with linear transforms. These transforms build 
signal representations that are not adapted to the local 
signal properties. 

[0004] Matching Pursuits is an alternative method of 
decomposing a signal into elementary structures that 
are locally adapted to the local signal properties. Match- 
ing Pursuits has excellent performance when compared 
with other compression techniques. Matching Pursuits 
performs signal analysis using an arbitrary over-com- 
plete dictionary set of basis waveforms. With a complete 
set of basis waveforms it is possible to completely rep- 
resent a given signal by a unique linear combination of 
the waveforms. With an over-complete basis set there 
may be many different combinations of the basis wave- 
forms which can represent the same given signal. This 
means that the most appropriate representation can be 
chosen for different circumstances. 
[0005] The Matching Pursuits process of decompos- 
ing a signal with the elementary structures of the dic- 
tionary basis set is shown in the block diagram of 
Figurel and described by the steps below. 

1. The algorithm initialises by calculating and stor- 
ing the correlation results between the signal and 
the dictionary set of basis waveforms. 

2. The data for one or more of the best correlation 
results is stored in a structure codebook. 

3. A decision is made as to whether to continue 
coding. For compression purposes this may be 
based on whether a given bit budget has been 
reached. 



4. If the decision is yes then the selected correlation 
elements of step 2 are subtracted from the original 
signal and the stored correlation results are 
updated. The process then loops back to step 2. 
5 5. If the decision is no then the signal can be recon- 
structed from the stored structure book. 

[0006] For a typical signal compression system the 
stored Matching Pursuits structure book will be effi- 

w ciently coded and stored or transmitted to a decoder. 
[0007] Figure 2 shows some waveforms (1 , 2 and 3) 
from an example one-dimensional basis dictionary (not 
shown) for analysis of a time varying signal. In the one- 
dimensional basis dictionary the waveforms can be 

is located anywhere in time. 

[0008] Application of the example dictionary set to an 
example function f(t) is shown in Figure 3a. After corre- 
lating the signal and the dictionary set of basis wave- 
forms the best match correlation g(t) shown in Figure 2 

20 is chosen (Figure 3b). The correlation coefficient, basis 
waveform and location in time are stored in the structure 
codebook. The stored element is subtracted from the 
original signal to generate the residual r(t) shown in Fig- 
ure 3c. The process iterates by finding the best correla- 

25 tion result of the residual signal and the dictionary set of 
basis waveforms. 

[0009] It is desirable to be able to model and represent 
multi-dimensional data by sets of multi-dimensional 
basis functions because a multi-dimensional basis func- 
30 tion may provide a better correlation than one-dimen- 
sional functions. 

[001 0] For speed of implementation and convenience 
of design, the multi-dimensional basis functions may be 
selected to be separable into one dimensional basis 
35 functions in orthogonal directions. The representation of 
the multi-dimensional data can then be treated as a 
series of one-dimensional problems. 
[001 1 ] There are problems associated with Matching 
Pursuits techniques. In particular, Matching Pursuits 
40 requires the iterated correlation of an over complete set 
of basis functions with the signal. The calculation of the 
correlation results is computationally very expensive 
making the analysis of large signals, such as video, 
computationally intractable in real time. 
45 [001 2] Accordingly, one object of the present invention 
is to provide a means by which the advantages of 
Matching Pursuits can be exploited without excessive 
computational effort. 

[0013] According to one aspect of the present inven- 
tion there is provided a method of matching a plurality of 
functions to a digital signal so as to represent the digital 
signal in terms of said functions comprising the steps of: 
determining one or more common factors in the plurality 
of functions; representing at least some of the functions 
in terms of one or more others of said functions thereby 
to reduce the amount of processing necessary for the 
matching. 

[0014] According to a second aspect of the present 
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invention there is provided apparatus for matching a 
plurality of functions to a digital signal so as to represent 
the digital signal in terms of said functions comprising a 
first processor for determining one or more common 
factors in the plurality of functions; and means for repre- 
senting at least some of the functions in terms of one or 
more others of said functions thereby to reduce the 
amount of processing necessary for the matching. 
[001 5] This has the advantage that there is no unnec- 
essary processing to determine the basis functions. 
Where commonality exists between basis functions 
then utilisation of this commonality reduces the 
processing power required during the matching proc- 
ess. This invention exploits commonality of basis func- 
tions. 

[001 6] Reference will now be made, by way of exam- 
ple, to the accompanying drawings, in which: 

Figure 1 is a prior art block diagram illustrating sig- 
nal decomposition using Matching Pursuits; 
Figure 2 is a diagram showing example elements 
from a one dimensional basis dictionary for analysis 
of time varying signals for use in the Matching Pur- 
suits technique in Figure 1 ; 
Figure 3 is a visualisation of the first iteration of 
Matching Pursuits encoding of an example signal 
using the basis dictionary set of Figure 2; 
Figure 4 is a flow diagram for the calculation of the 
original Matching Pursuits correlation coefficients 
for three waveforms from an over complete set; 
Figure 5 is a visual representation of an example 
over complete dictionary set of separable two 
dimensional waveforms basis function as a separa- 
ble two dimensional set; 

Figure 6 is a diagram of an example of functions 
created by the correlation of other functions to facil- 
itate the linked functions of the present invention; 
Figure 7 is a flow diagram for the calculation of 
Matching Pursuits correlation coefficients accord- 
ing to the present invention; and 
Figure 8 is a more complex example of determining 
linked basis functions. 

[001 7] In conventional Matching Pursuits the correla- 
tion coefficients at a given location in the signal for each 
basis function are calculated independently. 
[001 8] Comparing the basis function with a signal at a 
number of locations carries out the correlation. The 
number of locations being dependant on the length of 
the function. For example if the function has a length of 
10 units there will need be 10 multiplications and addi- 
tions to determine the correlation coefficient, for a 
length of 20 units, 20 multiplications and additions will 
be needed and so on. 

[001 9] The simplified flow diagram for the correlation 
calculation is shown in Figure 4. From this it is clear that 
each correlation is carried out completely independently 
which can be very costly on computational power. 



[0020] The computation required for correlation can 
be considered with some example one dimensional 
functions namely function 1 , function 2 and function 3. 
Assuming function 1 has a length 10, function 2 has a 

5 length 20 and function 3 has a length 30, then the calcu- 
lation of the three correlation coefficients at a given 
location in the original signal will require 10 + 20 + 30 = 
60 multiplications and additions. 
[0021 ] Figure 5 shows a typical dictionary set of sep- 

10 arable two dimensional functions used in Matching Pur- 
suits. It can be seen that these functions are 
represented as a plurality of optical features some of 
which are texture features, some edge features and 
some shape features. Each of the features can be sep- 

is arated into one dimensional functions in two orthogonal 
directions. Examples of such one dimensional functions 
are shown in the prior art figure 2. It will be clear that 
each feature in figure 5 can be represented in a similar 
manner. 

20 [0022] An important aspect of the present invention is 
the realisation that many of the one dimensional func- 
tions are very linked to others. For example, some are 
mirror images of each other (in one or other axis), some 
are merely larger than others, some are translations of 

25 others et cetera. With this realisation it has been possi- 
ble to move from an entirely random generation of a dic- 
tionary set (which is computationally impossible to 
handle in real time) to a designed dictionary set which 
requires considerably less computational effort. 

30 [0023] The realisation is that many of the functions 
have common features or are linked in some way for 
example are similar shape but a different size or what- 
ever. This realisation can be utilised to simplify certain 
functions which have common or linked features with 

35 one or more of the other functions. This can be achieved 
since the certain function can be represented as an 
operation of the one or more other functions. The oper- 
ation is dependent on the linkage or commonality of the 
function. In many circumstances this would mean that 

40 less computational effort is used than would be the case 
for carrying out the normal Matching Pursuits process 
for a given feature. This will be described in greater 
detail below. 

[0024] As previously indicated functions can be repre- 
ss sented perfectly or approximated well by linking them 
with one or more other functions. Figure 6 shows some 
example functions created by the repeated correlations 
of short functions. Function 2 is the result of correlating 
function 1 with itself. Function 3 is the result of correlat- 
50 ing function 1 and function 2. Thus the long functions 
can be considered as linked to the shorter functions in 
some predetermined manner. 
[0025] With knowledge of this it is possible to deter- 
mine whether it is better, in terms of computational 
55 effort, to represent a function as itself or as linked to one 
or more other less complex functions. 
[0026] Figure 7 shows the flow diagram for the Match- 
ing Pursuits correlation calculation equivalent to that 
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shown in figure 4, but using linked or common basis 
functions. The function used to form basis 2, function 2, 
is the result of correlating function 1 with Afunction 2. 
The correlation coefficients for function 2 with the origi- 
nal signal are calculated by correlating Afunction 2 with 5 
the stored results of basis 1 . The function used to form 
basis 3, function 3, is the result of correlating function 2 
with Afunction 3. The correlation coefficients for function 
3 with the original signal are calculated by correlating 
Afunction 3 with the stored results of basis 2. w 
[0027] The computation required for this correlation 
can be considered with the same size one dimensional 
functions as before. Function 1 has length 10, function 2 
has length 20 and function 3 has length 30. This means 
that for the link function for Afunction 2 has length 1 1 is 
and for Afunction 3 has length 1 1 . Thus the calculation 
of the three correlation coefficients at a given location in 
the original signal using the link functions will require 1 0 
+ 11 + 1 1 = 32 multiplications and additions. 
[0028] The example has demonstrated how using 20 
linked basis functions the correlation computation can 
be significantly reduced as compared to normal basis 
functions. When using more linked basis functions the 
computation savings will be even greater. 
[0029] In real applications of Matching Pursuits there 25 
may be requirements for basis functions that are not 
fully realisable using the linked functions described 
above. In such circumstances a combination of normal 
and linked basis functions may be used, allowing the 
computational advantages of the linked basis to be real- 30 
ised where possible. 

[0030] The above mentioned process may be of par- 
ticular use in the efficient coding of the motion estima- 
tion residuals in video compression. 
[0031] There now follows a description of a more com- 35 
plicated linked basis function of the Matching Pursuits. 
[0032] Figure 8 shows a more complicated example of 
the application of linked basis functions. The short func- 
tions (scale 0, scale 1 , scale 2 and edge) that are linked 
to create the nine basis functions have their coefficients 40 
detailed in the table shown in Figure 8. Starting from the 
original signal (basisO) the function scale 0 is applied to 
produce the basis 1 results. The function edge is 
applied to the basis 1 results to produce the basis 6 
results. Similarly the function scale 0 applied to the 45 
basis 1 results produces the basis 2 results and so on. 
Thus the common factors or features of the desired 
basis can be exploited to reduce the computation e.g.: 
the basis 1 results are a common factor of both basis 6 
and basis 2. so 
[0033] It should be noted that of the short functions 
scale 0, scale 1 , scale 2 and edge only the non-zero 
coefficients are used in the correlation calculations. 
Thus correlation of scale 2 only requires five multiplica- 
tions and additions. ss 
[0034] Linking the short basis creates successively 
longer basis functions e.g.: basis 4 of Figure 8 is longer 
than basis 3. The resulting basis functions created by 



the flow and short functions of Figure 8 are visualised in 
Figure 5 as the two dimensional separable functions 
created by combination of the nine one dimensional 
basis functions. 

[0035] In application the coefficients of each basis are 
normalised such that the correlation of a basis with itself 
produces a correlation coefficient of one. 
[0036] It will be appreciated that there are many ways 
in which the present process may be carried out and still 
remain within the scope of the invention. The most 
important concept in the identification of the fact that 
there are many functions in a signal which can be repre- 
sented as an operation of a more simple function. This 
is particularly important where the function is very com- 
plicated and/or does not occur very often. 

Claims 

1. A method of matching a plurality of functions to a 
digital signal so as to represent the digital signal in 
terms of said functions comprising the steps of: 

determining one or more common factors in the 
plurality of functions; 

representing at least some of the functions in 
terms of one or more others of said functions 
thereby to reduce the amount of processing 
necessary for the matching. 

2. The method of claim 1 , further comprising deter- 
mining a first function for a section of the digital sig- 
nal; and further determining a further function from 
the first function. 

3. The method of claim 2, wherein the step of deter- 
mining the first function comprises correlating the 
section of the signal with one of the plurality of basis 
functions to produce a correlation coefficient. 

4. The method of claim 3, wherein the further deter- 
mining step comprises calculating the further func- 
tion from the correlation coefficient and a variable 
which indicates the difference between the first and 
further functions. 

5. The method of claim 4, further comprising providing 
the variable as an indicator of difference in size, 
shape, position and/or relative orientation. 

6. The method of any of claims 1 to 5, further compris- 
ing providing the digital signal as a digital video sig- 
nal. 

7. The method of any of claims 1 to 6, further compris- 
ing applying the method to the task of digital com- 
pression such that the digital signal is compressed 
prior to transmission. 
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8. The method of any of claims 1 to 7, further compris- 
ing analysing the processing required to determine 
the further function and choosing either to deter- 
mine the further function from the first function or to 
determine the further function independently from 5 
the plurality of basis functions dependant on which 
needs the least amount of processing capacity. 



9. Apparatus for matching a plurality of functions to a 
digital signal so as to represent the digital signal in 10 
terms of said functions comprising: 

a first processor for determining one or more 
common factors in the plurality of functions; 
and 15 
means for representing at least some of the 
functions in terms of one or more others of said 
functions thereby to reduce the amount of 
processing necessary for the matching. 

20 

10. Apparatus according to claim 9, further comprising 
a second processor for determining a first function 
for a section of the digital signal; and a third proces- 
sor for determining a further function from the first 
function. 25 

11. The apparatus of claim 10, wherein the second 
processor comprises a correlator for correlating the 
section of the signal with one of the plurality of basis 
functions to produce a correlation coefficient. so 

12. The apparatus of claim 11, wherein the third proc- 
essor calculates the further function from the corre- 
lation coefficient and a variable which indicates the 
difference between the first and further functions. 35 

13. The apparatus of claim 12, wherein the variable is 
an indicator of difference in size, shape, position 
and/or relative orientation of the first and further 
function. *o 

14. The apparatus of any of claims 9 to 13, wherein the 
digital signal is a digital video signal. 

15. The apparatus of any of claims 9 to 14, for use in 45 
the task of digital compression such that the digital 
signal is compressed prior to transmission. 

1 6. The apparatus of any of claims 9 to 1 5, further com- 
prising an analyser for analysing the processing so 
required to determine the further function and 
choosing either to determine the further function 
from the first function or to determine the further 
function independently from the plurality of basis 
functions dependant on which needs the least 55 
amount of processing capacity. 
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(54) Digital signal processing 



(57) According the present invention there is pro- 
vided apparatus for matching a plurality of functions to a 
digital signal so as to represent the digital signal in 
terms of said functions comprising a first processor for 
determining one or more common factors in the plurality 
of functions; and means for representing at least some 
of the functions in terms of one or more others of said 
functions thereby to reduce the amount of processing 
necessary for the matching. 

Where there is commonality and the process would 
require less processing potential to make use of this 
than not then the commonality is exploited. 
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